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Abstract 
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Few  studies  of  perinatal  predictors  of  child  maltreatment  have  examined  the 
predictive  validity  of  a  rating  scale  or  have  used  the  scale  to  structure  clinical  judgment  to 
identify  high-risk  families.  Therefore,  we  conducted  a  cohort  study  to  test  the  predictive 
validity  of  the  Kung-Leventhal  Parenting  Scale  (K-L),  a  22-item  rating  scale  used  to 
provide  structure  to  clinical  judgment  in  the  postpartum  period  to  identify  newborns  at 
risk  of  maltreatment. 

During  the  postpartum  period,  clinicians  completed  the  K-L  on  a  consecutive 
sample  of  363  infants  who  were  bom  between  November  1989  and  September  1990  and 
planned  to  use  the  hospital’s  primary  care  center  for  pediatric  care.  Based  on  scoring 
criteria  for  inclusion  in  the  study,  159  infants  were  eligible,  50  of  whom  were  categorized 
as  moderate/high  risk  and  109  as  low  risk  infants.  Items  on  the  K-L  were  based  on 
maternal  characteristics,  paternal  characteristics,  maternal-infant  interactions,  and 
stability  of  the  home  environment.  Each  item  was  scored  by  a  clinician  (pediatrician  or 
social  worker)  on  a  4-point  scale  from  0  to  3,  and  an  infant  was  categorized  as 
moderate/high  risk  if  the  arithmetic  sum  of  the  scores  was  >  9.  Fifty  of  the  no/low  risk 
sample  were  randomly  selected  for  comparison  with  the  moderate/high  risk  group.  After 
excluding  children  who  had  not  received  health  care  in  the  New  Haven  area,  we  reviewed 
the  medical  records  of  92  children  at  four  health  care  sites  (the  only  two  hospitals  and 
two  neighborhood  health  centers)  from  birth  to  the  fourth  birthday  to  determine  the 
outcomes  of  maltreatment,  major  changes  in  the  child’s  caretaker,  and  growth  concerns. 
Using  predefined  criteria,  events  were  classified  as  maltreatment  (abuse,  neglect  and/or 
abandonment)  or  unintentional  injuries  by  two  clinicians,  one  of  whom  was  blinded  to  the 


child’s  risk  status. 


Of  the  92  children  who  met  eligibility  criteria  for  the  study,  42  were  classified  as 
moderate/high  risk,  47  were  no/low  risk  and  3  were  excluded  because  of  adoption  at  birth 
or  placement  at  birth  into  foster  care.  Maltreatment  occurred  in  28.6%  of  the 
moderate/high-risk  and  8.5%  of  the  no/low-risk  groups  (RR  =  3.36,  95%  CI=  1.17,  9.62; 
p  =0.013).  Changes  in  the  caretaker  were  also  more  frequent  in  the  moderate/high-risk 
group  (RR  =  11.2;  95%  CI=  1.50,  83.78;  p  =0.001).  Differences  in  growth  concerns  were 
not  statistically  significant  (RR  =  1.49,  95%  CI=  0.35,  6.29;  p  =  NS).  At  least  one  of  the 
above  major  outcomes  occurred  in  38.1%  of  the  moderate/high-risk  group  and  14.9%  of 
the  no/low-risk  group  (RR=  2.56,  95%  CI=  1.17,  5.61;  p=0.012). 

We  conclude  that  the  use  of  a  rating  scale  in  the  postpartum  period  to  provide 
structure  to  clinical  judgment  can  effectively  identify  infants  who  are  at  high  risk  of 
maltreatment  and  other  significant  medical  and  social  concerns. 
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Introduction 

A  Brief  Overview 

Historically,  the  American  society  has  not  been  kind  to  children.  Children  have  been 
considered,  at  different  times  in  history,  nothing  more  than  animals,  servants,  or  mere  property. 
In  fact,  in  one  of  the  earliest  widely  publicized  cases  of  child  maltreatment  in  1874,  the 
perpetrator  was  tried  under  the  laws  against  cruelty  to  animals.  There  were  no  such  laws  then  to 
protect  children  against  the  wrath  of  parents  or  guardians.  The  Society  for  the  Prevention  of 
Cruelty  to  Animals  continued  to  aid  maltreated  children  until  the  birth  of  the  Society  for  the 
Prevention  of  Cruelty  to  Children  in  1875. 


I:  The  Law 

The  Child  Abuse  Prevention  and  Treatment  Act  of  1 974  resulted  in  statutes  in  all  states, 
protecting  children  from  physical,  sexual,  and  psychological  abuse,  as  well  as  neglect  and 
abandonment.  Under  these  statutes,  professionals  are  mandated  to  report  suspected  cases  of  child 
maltreatment.  Such  reports  are  to  be  investigated  for  substantiation.  If  documented,  the 
investigator  has  a  legal  responsibility  to  remove  the  child  from  these  circumstances,  and  to  have 
the  child  placed  under  temporary  guardianship  or  to  provide  adequate  supervision  of  the  child 
within  the  home. 

The  laws  to  protect  children  from  maltreatment  have  tried  to  do  so  with  requirements  that 
the  states  make  an  effort  to  preserve  the  family.  Some  authors  have  supported  this  policy, 
arguing  that  separation  of  the  child  from  parents  is  not  in  the  best  interest  of  the  child.  Others, 
however,  have  decried  this  policy  as  preservation  of  an  unhealthy  environment,  under  the  pretext 
of  maintaining  the  family  unit,  at  the  expense  of  the  child.  The  price  of  this  emphasis  on  family 
preservation  rather  than  the  child  is  measured  in  lives  lost  and  continued  maltreatment  if  the 
parents  are  not  rehabilitated. 
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More  recently,  in  November  1997,  the  Adoption  and  Safe  Families  Act  of  1997  was 
signed  into  law.  This  law  requires  that  "...child  safety  be  the  highest  priority  when  making 
service  provision,  placement  and  permanency  planning  decisions  for  children"  (34).  The  law 
requires  that  states  make  efforts  to  preserve  the  family,  but  cites  specific  instances  when  there  is 
no  such  requirement  such  as  "...  when  doing  so  places  a  child's  safety  in  jeopardy"  (34). 

II:  The  Definition 

Allegations  of  child  abuse  or  neglect  require  at  least  a  'preponderance  of  evidence'  and 
sometimes  more  stringent  proof  of 'clear  and  convincing  evidence.'  This  has  presented  problems 
particularly  because  the  definition  of  abuse  and  neglect  is  sometimes  subject  to  varying  degrees 
of  interpretation.  The  definition  of  child  abuse  and  neglect  has  undergone  many  revisions  over 
the  years,  as  researchers  have  attempted  to  construct  standardized  methods  to  identify  these 
social  phenomena.  David  Gil  defined  child  abuse  in  1968  as:  "the  occurrence  in  which  a 
caretaker,  usually  an  adult,  injures  a  child,  not  by  accident,  but  deliberately "(1 1). 

He  further  defined  child  abuse  as:  "[inclusive  of]  not  only  injury  due  to  acts  of  commission,  but 
also  acts  of  omission,  such  as  malnutrition  from  the  intentional  withholding  of  food." 

The  latter  part  of  the  definition  was,  in  essence,  a  description  of  child  neglect. 

Since  then,  there  have  been  more  specific  definitions  for  the  different  categories  of  child 
maltreatment.  Wissow  (1995)  defined  maltreatment  as  "intentional  harm  or  a  threat  of  harm  to  a 
child  by  someone  acting  in  the  role  of  caretaker,  for  even  a  short  time."  He  defines  more 
specifically,  physical  abuse  as  involving  the  infliction  of  "bodily  injury  through  excessive  force 
or  forcing  a  child  to  engage  in  physically  harmful  activity."  He  defined  emotional  abuse  as 
"coercive,  demeaning  or  overly  distant  behavior  by  a  parent  or  other  caretaker  that  interferes  with 
a  child's  normal  social  or  psychological  development."  Sexual  abuse  was  defined  as 
"inappropriate  exposure  of  a  child  to  sexual  acts. ..use. ..as  sexual  stimuli  for  adult,  and  actual 
sexual  contact  between  children  and  older  people."  Finally,  neglect  was  defined  as  "the  failure  to 
provide  the  basic  shelter,  supervision,  medical  care,  or  support  "  (36). 
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Child  maltreatment  is  not  easily  defined.  In  part,  this  is  because  it  must  be  accorded  an 
anti-social  status,  and  this  precludes  the  existence  of  a  standard  of  parenting  that  is  socially 
acceptable.  While  some  forms  of  maltreatment  of  children,  for  instance  maiming  a  child,  is 
easily  labeled  as  such,  other  less  dramatic  forms  of  abuse  and  neglect  are  more  difficult  to 
identify.  Further,  there  is  often  some  hesitancy  in  defining  a  global  standard  of  parenting. 
Spanking  a  child  with  a  belt,  for  instance,  may  constitute  strict  discipline  or  physical  abuse 
depending  on  the  observer’s  opinion. 

One's  definition  of  maltreatment  may  also  depend  on  statutes  that  govern  this  issue  and 
the  intention  of  the  perpetrator.  Physical  abuse  is  most  commonly  defined  as  "an  act  of 
commission...  but.. .may  specify  an  act,  an  act  and  a  consequence,  or  merely  a  consequence." 
Thus,  attempting  to  strike  a  child  with  a  large  object  (an  act)  with  the  intention  of  hurting  the 
child  may  be  considered  abuse  whether  or  not  the  child  is  hurt  (a  consequence),  because  in  fact, 
the  attempt  constitutes  endangerment. 

While  the  definition  of  child  maltreatment  has  evolved,  much  research  has  been  done  in 
identifying  the  prevalence,  etiology,  consequences  and  therapy.  The  landmark  article  by  Henry 
Kempe,  et  al,  which  described  the  so-called  ‘battered-child  syndrome,’  focused  mainly  on 
physical  abuse  and  its  psycho-pathologic  etiology  (17).  Following  this  article  published  in  1962, 
research  has  been  done  to  enhance  the  clinical  diagnosis  of  abuse  and  neglect  and  to  predict  the 
risk  of  maltreatment  based  on  diverse  etiological  factors. 

Ill:  The  Trends 

In  1976,  the  National  Child  Abuse  and  Neglect  data  system  compiled  the  first  national 
data  regarding  the  incidence  of  child  maltreatment.  At  the  time,  416,033  reports  of  maltreatment, 
affecting  669,000  children,  were  made  in  one  year.  By  1990,  almost  2.6  million  reports  of  child 
maltreatment  were  made.  Approximately  one-third  (800,000)  of  the  reports  were  substantiated. 
Fifty-two  percent  of  the  victims  were  female  (35).  By  1994,  the  number  of  substantiated  cases  of 
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maltreatment  was  1,01 1,628  and  in  1997  the  number  rose  to  1,054,000.  There  were  an  estimated 
1,185  child  maltreatment  fatalities  in  1996,  76%  of  whom  were  less  than  4  years  of  age  (34). 

The  significant  increase  in  the  occurrence  of  child  maltreatment  is  most  likely  due  to:  (a) 
broadening  definitions  of  maltreatment  over  the  years,  (b)  increased  recognition  and  reporting 
fueled  by  legislation  requiring  professional  reporting,  recommendations  and  growing  public 
concern,  and  (c)  worsening  socioeconomic  conditions,  for  example,  increased  poverty  and  drug 
abuse.  Although  reports  have  increased  since  the  1970s,  it  is  conceivable  that  many  incidents  of 
child  maltreatment  are  never  reported,  and  therefore  the  statistics  do  not  capture  the  full  extent  of 
the  problem.  According  to  the  National  Center  on  Child  Abuse  and  Neglect  (NCCAN): 

"Given  that  only  the  most  serious  episodes  of  abuse  are  reported,... chi  Id  maltreatment  is  most 
likely  underreported  and  underestimated  in  official  reports." 
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Why  Do  Parents  Maltreat  their  Children? 

The  question,  although  simplistic,  is  one  that  is  asked  every  time  one  turns  the  page  of  a 
newspaper  and  reads  of  the  little  girl  who  was  beaten  to  death  by  her  mother,  or  the  newborn 
baby  who  was  dumped  in  a  garbage  pail.  The  question  beckons  one  to  climb  into  the  mind  of  the 
person  who  would  harm  a  child.  Are  they  crazy?  Are  they  simply  cruel?  Why  did  they  do  it? 

There  have  been  many  studies  that  have  suggested  and  discounted  varying  psychosocial 
factors  that  may  predispose  to  maltreatment.  Some  authors  have  suggested  that  a  major  flaw  in 
many  of  these  studies  has  been  the  lumping  of  abuse  and  neglect  as  maltreatment  rather  than 
identifying  separate  risk  behaviors  for  different  types  of  abuse  and  neglect  (18). 

Child  maltreatment  occurs  when  there  are  deficits  in  the  ecology  of  parenting,  negative 
feelings  towards  the  child,  and  there  is  parental  loss  of  control.  An  ecological  framework 
proposed  by  Belsky  integrates  the  varying  etiologies  of  child  maltreatment.  Essentially  this 
model  identifies  the  individual  (parent  and  child),  the  family  (the  microsystem),  the  community 
(the  exosystem),  and  the  culture  (the  macrosystem)  as  interactive  forces  that  determine  the 
occurrence  of  child  maltreatment  (2). 


I:  The  individual 

Belsky  suggests  that  "psychological  disturbances  in  parents  [and]  abuse-eliciting 
characteristics  of  children"  contribute  to  child  abuse  and  neglect.  The  chronically  depressed 
mother  or  the  mother  who  abuses  drugs  may  neglect  her  child  (as  well  as  herself).  The  abusive 
parent  may  have  learned  this  behavior  through  his  own  experiences  of  abuse.  It  has  been 
generally  accepted  that  abuse  begets  abuse  even  though  some  authors  suggest  that  this  only 
occurs  to  a  limited  extent  (18).  Heifer  (1976)  suggested  that  the  maltreatment  of  children  is  a 
manifestation  of  abnormal  child-rearing  practices  which  the  maltreater  learned  from  their 
childhood  experiences  (13).  The  phenomenon  of  transgenerational  abuse  is  a  compelling 
argument  for  prevention  strategies.  The  neglectful  mother  may  lack  the  nurturing  attitudes 
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required  to  care  for  a  child,  because  of  the  lack  of  a  nurturing  environment  during  her  own 
childhood.  There  is  a  paucity  of  evidence  however,  that  indicates  a  standard  psychological 
profile  of  an  abusive  or  neglectful  parent  (18). 

Abuse-eliciting  characteristics  of  a  child  refer  to  such  factors  as  prematurity,  low 
birthweight,  physical  disability,  twin  gestation,  which  have  been  studied  as  risk  factors  of  child 
maltreatment.  The  appearance  of  the  child,  and  the  temperament  of  the  child  play  a  role  in 
precipitating  abuse.  For  example,  a  colicky  baby  is  more  likely  to  elicit  aggression  in  a  parent 
than  a  baby  who  cries  less.  Although  some  studies  have  shown  an  association  between 
prematurity,  low  birthweight  and  maltreatment,  Leventhal  (1984)  concluded  that  these  were  not 
major  predictors  of  abuse  (21). 


II:  The  family 

Abusive  and  neglectful  families  tend  to  exhibit  "dysfunctional  patterns  of  family 
interaction"  Belsky  suggests  that  "child  maltreatment  may  be  the  eventual  ...consequence  of  an 
escalating  cycle  of  parent-child  conflict  and  aggression”  (2).  In  such  abnormal  relationships, 
maltreatment  may  occur  as  a  means  of  disciplining  the  child.  Abuse  and  neglect  may  continue 
because  the  caring  parent-child  relationship  and  the  feelings  of  empathy  are  absent  making  the 
parent  "[insensitive]  to  the  pain  they  cause  their  victims"  Indeed,  the  parent  may  have  unrealistic 
expectations  of  the  child,  seeking  comfort  from  the  child.  Domestic  violence  is  often  a  part  of  the 
lives  of  such  families.  Further,  marital  instability  may  exhibit  a  pattern  of  domestic  violence 
and/or  cause  a  mother  to  seek  comfort  from  a  child.  Abuse  may  be  the  result  when  the  child  is 
unable  to  fulfill  such  expectations. 


Ill:  The  community 

According  to  the  ecological  framework  of  child  maltreatment,  the  neighborhood  and  the 
workplace  are  most  influential  at  the  level  of  the  community  in  contributing  to  child 
maltreatment.  There  is  acknowledgment  that  maltreatment  affects  all  socioeconomic  levels  of 
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society.  However,  it  is  true  that  poverty  with  unemployment  or  underemployment  imposes 
stresses  on  the  individual  that  increases  the  risk  of  neglect  and  physical  abuse  (36).  Leventhal 
(1989)  suggested  that  using  socioeconomic  factors  as  a  marker  for  maltreatment  is  not  helpful. 
He  acknowledges,  however,  that  to  the  extent  that  poverty  is  a  stressor,  "a  different  set  of 
predictors  or  a  different  demarcation  to  indicate  risk... [may  be  used]  for  the  two  types  of 
population  [broad  social  classes  and  low  income  groups],  "  (20) 

The  social  supports  within  the  community  that  are  available  to  a  parent  or  a  family  may 
affect  the  likelihood  of  maltreatment  occurring  because  if  help  is  sought  from  relatives,  friends, 
neighbors,  or  social  services,  the  stressor  may  be  removed.  The  situation  may  be  defused,  and 
the  incident  of  abuse  may  be  averted.  Social  isolation  is  defined  as  "a  lack  of  someone  to  turn  to 
for  help;  a  lack  of  social  support"  (27).  Many  studies  have  indicated  the  importance  of  social 
supports— friends  and  family—  in  understanding  the  occurrence  of  abuse  and  neglect  of  children. 
Much  of  social  services  in  the  USA,  indeed  internationally,  have  been  dedicated  to  programs 
with  the  basic  goal  of  improving  the  social  network  of  high-risk  individuals.  These  programs 
include  home  visitation,  community  groups  that  may  target  a  specific  problem  such  as  peer 
groups  for  drug  users,  and  groups  that  teach  parenting  skills  to  young  mothers. 

IV:  The  culture 

Many  authors  have  placed  the  blame  for  the  maltreatment  of  children  on  the  violence  that 
exists  in  the  American  society  and  the  passive  acceptance  of  this  violence  as  part  of  this  culture: 
"The  root  of  violence  that  culminates  in  parents  and  other  adults  who  physically  assault 
children.. ..represent  a  part  of  our  biosocial  heritage  that  has  gone  awry"  (30). 
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Prevention  and  Prediction 

For  any  illness  or  any  negative  social  outcome,  there  are  three  approaches  to  prevention. 
Primary  prevention  seeks  to  increase  public  awareness  and  to  influence  the  society's  attitudes 
towards  the  issue  of  child  abuse  and  neglect.  Secondary  prevention  targets  a  segment  of  the 
population  that  has  been  identified  to  be  at  high  risk  and  seeks  to  prevent  maltreatment.  Tertiary 
prevention  seeks  to  halt  the  potential  continuation  and  cycle  of  maltreatment. 

Physicians,  particularly  obstetricians  and  pediatricians  are  in  an  excellent  position  to 
exercise  clinical  judgment  to  identify  high-risk  families.  Thus,  much  of  the  preventive  work  has 
been  done  in  secondary  prevention. 

In  1993,  NCCAN  recommended  that:  "studies  are  needed  to  identify  not  only  which 
parents  do  or  do  not  maltreat  children  under  conditions  of  high  risk  but  also  those  that  do  or  do 
not  maltreat  under  conditions  of  low  risk."  (35) 

It  is  inevitable  that  predictions  of  a  high  or  low  risk  status  will  result  in  some  exceptions 
to  expectations.  Nevertheless,  a  highly  specific  and  sensitive  screening  instrument  should  reduce 
such  exceptions.  Further,  while  it  may  cause  some  pain  or  inconvenience  to  the  parents  for  being 
labeled  as  ‘high  risk,’  it  is  to  the  child's  advantage  to  err  on  the  side  of  overestimation,  rather 
than  missing  a  child  who  is  potentially  at  risk  of  maltreatment. 

Previous  studies  have  attempted  to  predict  high-risk  families  using:  (a)  sociodemographic 
checklists,  (b)  structured  prenatal  interviews,  (c)  unstructured  clinical  judgments,  and  (d) 
structured  clinical  judgments.  In  reviewing  the  studies,  the  following  calculations  were  made: 
(a)  the  positive  predictive  value  (PPV)  (the  percentage  of  children  identified  as  high-risk  who 
were  subsequently  maltreated,  (b)  the  sensitivity  (the  percentage  of  maltreated  children  who  were 
identified  as  high  risk),  and  (c)  the  specificity  (the  percentage  of  children  not  maltreated  who 
were  identified  as  low  risk). 

The  sociodemographic  checklist  often  relegates  those  of  low  socio-economic  status  to  a 
high-risk  status.  Although,  poverty  does  create  stressors  that  may  precipitate  abuse,  the  majority 
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of  poor  people  do  not  maltreat  their  children.  Therefore,  by  itself,  it  is  not  a  useful  predictor  of 
abuse  or  neglect.  The  authors  of  one  study  concluded  that  “child  maltreatment  is  not  a  function 
of  poverty,  per  se,  but  depends  upon  the  availability,  adequacy,  and  use  made  of  a  family’s 
supportive  resources  in  the  community”  (31).  A  socioeconomic  checklist  is  not  useful  in  many 
urban  populations  in  which  low  income  groups  are  predominant.  Neither  would  it  be  useful  in 
higher  income  groups  as  it  would  result  in  a  high  false  negative  error  rate. 

The  structured  prenatal  interview  requires  trained  personnel  such  as  a  research  assistant. 
The  interview  may  be  very  detailed  and  time  consuming.  One  such  study  was  conducted  by 
Brayden,  Altemeier,  et  al  (3).  Interviewers  received  training  in  administering  the  interview, 
which  addressed  the  mother’s  knowledge  of  parenting  skills,  philosophy  about  discipline, 
personality,  positive  and  negative  feelings  about  the  pregnancy,  perception  of  being  nurtured 
during  childhood,  life  stresses,  frequent  changes  of  residence,  previous  removal  of  children  by 
child  protective  services,  suggestion  of  maternal  abusive  tendencies  by  comments  or  behavior, 
and  ‘gross  untruthfulness  in  the  interview.’  Of  1089  low  income  women  who  were  assigned  to  a 
risk  category  using  the  structured  interview  done  during  the  prenatal  period,  28.8%  were 
categorized  as  high  risk.  Of  the  high-risk  group,  154  received  only  standard  care  and  160 
received  specialized  intervention  services.  Reports  to  the  protective  services  were  reviewed  for 
physical  abuse,  neglect,  sexual  abuse  and  separation  of  mother  and  child  up  to  36  months  of  age. 
The  reports  were  then  assessed  by  pediatricians  blind  to  the  families’  risk  status  as  virtually 
certain,  probable,  doubtful  or  having  no  evidence.  Reports  rated  as  virtually  certain  or  probable 
were  considered  positive  outcomes.  This  screening  instrument  had  a  positive  predictive  value  of 
6.6%,  sensitivity  of  55.6%,  and  specificity  of  71 .9%  for  physical  abuse.  There  was  no  significant 
difference  in  the  high-risk  non-intervention  group  and  the  low-risk  control  group  for  outcomes  of 
neglect  and  separation  of  the  child  from  the  mother  (3). 
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I:  Review  of  studies  using  Unstructured  Clinical  Judgment 

Unlike  a  structured  prenatal  interview,  clinical  judgment  can  be  made  routinely. 
Everyday  when  clinicians  see  patients  they  form  impressions  based  on  the  patient's  appearance, 
attitudes,  history  and  physical  examination.  This  unstructured  clinical  judgment  has  been  used 
widely  to  identify  those  children  at  risk  of  maltreatment  and  who  would  benefit  from 
interventions.  The  unstructured  clinical  judgment  is  reliant  on  a  clinician  being  experienced  and 
unbiased. 

Gray  et  al.,  1977  conducted  prenatal  interviews,  used  a  questionnaire,  and  observations  of 
labor  and  delivery  and  postpartum  interactions  to  classify  subjects  into  a  high-risk  category. 
They  used  a  cohort  of  350  subjects  who  were  first-  or  second-boms.  Of  the  initial  sample,  28.6% 
was  categorized  as  high  risk  (100  subjects),  and  50  low  risk  children  were  randomly  selected  for 
comparison.  Outcomes  were  reports  to  the  child  abuse  registry,  occurrence  of  non-organic 
failure-to-thrive,  and/or  a  change  in  a  child's  primary  caretaker.  Outcomes  were  determined 
between  17  and  35  months.  Of  the  high-risk  group,  2.3%  were  reported  to  the  child  abuse 
registry  (PPV=  8%,  sensitivity  =  100%,  specificity  =  73%),  2.9%  had  the  outcome  of  non- 
organic  failure-to-thrive  (PPV=  10%,  sensitivity  =  100%,  specificity  =  74%)  and  4.6%  had 
changes  in  their  caretaker  (PPV=  16%,  sensitivity  =  100%,  specificity  =  75%).  None  of  the  low 
risk  children  had  any  of  the  major  outcomes  (12). 

Dean  et  al.,  1978,  examined  a  population  of  7,700  births  in  Aberdeen,  Scotland  with 
representation  of  all  social  classes.  Babies  were  identified  as  high  risk  based  on  a  health 
professional's  concern  at  a  home  visit  when  the  child  was  3-4  months  of  age.  This  study  found 
6.6%  of  the  population  to  be  at  high  risk  for  maltreatment.  Outcomes  were  based  on  abuse, 
neglect,  or  failure-to-thrive,  and  were  determined  at  2  years;  4.3  %  of  the  population  had  at  least 
one  of  these  outcomes  (PPV=  17%,  sensitivity  =26%,  specificity  =94%)  (7). 
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Ounsted  et  al.,  1982,  had  a  sample  of  5,  356  children  from  a  wide  range  of  social  classes, 
bom  at  a  general  hospital.  Newborns  were  classified  as  high  risk  based  on  the  concerns  of 
midwives  regarding  the  parents'  ability  to  cope  with  the  newborn;  2%  were  considered  high  risk. 
Outcomes  were  reports  to  the  child  abuse  registry  and  persistent  clinical  concern  for  the  child. 
Outcome  was  determined  at  one  year,  with  0.5%  of  the  population  having  had  the  outcome 
(PPV=  1 8%,  sensitivity^  76%,  specificity=  98%)  (26). 

Leventhal,  Garber  and  Brady  (1989)  studied  a  sample  of  1800  infants  of  lower 
socioeconomic  status  receiving  care  at  an  urban  hospital.  The  clinician's  judgment  during  the 
postpartum  period  was  used  to  classify  infants  in  a  high-risk  category;  6.3%  were  classified  as 
high  risk.  Outcomes  were  based  on  abuse  or  neglect  based  on  review  of  the  medical  records  and 
/or  changes  in  the  caretaker.  The  outcomes  were  determined  at  4  years;  8.8%  of  the  population 
had  a  positive  outcome  based  on  abuse  or  neglect  recorded  in  the  medical  records  (PPV=  23%, 
sensitivity  =  16%,  and  specificity  =  92%;  7.8%  had  a  positive  outcome  based  on  changes  in  the 
caretaker  (PPV=  46%,  sensitivity  =  38%,  and  specificity  =  96%)  (22). 

II:  Review  of  studies  using  Structured  Clinical  Judgment 

The  structured  clinical  judgment  has  pre-determ ined  variables  that  are  scored  to  develop  a 
risk  score.  This  method  does  not  necessarily  require  significant  experience.  Structured  clinical 
judgment  seeks  to  identify  those  children  who  are  at  risk  of  maltreatment  using  a  standard  set  of 
risk  factors  that  are  identified  by  history  and  clinical  impressions.  The  perinatal  period  is  the 
ideal  time  to  make  such  assessments,  so  that  adequate  supports  can  be  provided  for  at  risk 
families. 

Lealman,  et  al.,  (1983)  used  a  checklist  of  predictors  that  were  obtained  from  the  medical 
records  to  assess  a  group  of  2802  infants.  Risk  factors  were  classified  as  major  or  minor.  The 
major  factors  were  maternal  age  less  than  20  at  birth  of  first  child,  first  prenatal  visit  after  20 
weeks  gestation  and  unmarried  mother.  Minor  risk  factors  were  presence  of  step  children  in  the 
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family,  maternal  psychiatric  history,  previous  referral  to  social  worker,  unwanted  pregnancy, 
complications  during  pregnancy  and  delivery,  baby's  admission  to  the  special  care  unit,  and 
mother  leaving  against  medical  advice. 

Children  were  classified  as  high  risk  if  they  had  at  least  3  factors,  with  at  least  one  being 
a  major  factor.  The  high  risk  group  was  further  classified  into  a  high  risk  intervention  group 
which  was  contacted  by  a  social  worker  and  was  able  to  access  help  from  health  personnel  once 
per  week  at  a  'drop  in'  center,  a  high  risk  non-intervention  group  and  a  high-risk  social  work 
group  who  had  been  getting  social  work  help  prior  to  the  study.  Of  the  families  studied,  1 8% 
were  classified  as  high  risk,  20%  of  whom  were  in  the  intervention  group,  41%  in  the  non¬ 
intervention  group,  and  39%  in  the  social  work  group. 

Outcomes  were  determined  when  the  infants  were  1 8-months-old  and  were  based  on  the 
occurrences  of  failure-to-thrive,  missed  immunizations,  injuries  seen  in  emergency  room,  injuries 
or  social  issues  requiring  hospitalization,  deaths,  social  work  involvement,  and  records  of  abuse 
in  the  child  abuse  registry.  Of  the  groups,  the  high-risk  social  work  group  had  the  highest 
percentages  of  failure-to-thrive  and  abuse  or  neglect  recorded  in  the  child  abuse  registry  than  all 
other  groups. 

Including  all  the  high-risk  families  as  one  group,  the  following  were  calculated  for  abuse: 
PPV  3.5%,  sensitivity  66.7%  and  specificity  82.2%.  The  authors  provided  no  information 
concerning  the  socioeconomic  status  of  the  population.  Interventions  were  available  that  could 
possibly  have  affected  the  occurrence  of  maltreatment  (19). 

In  a  study  done  by  Murphy,  Orkow  and  Nicola  (1985),  the  parents  were  recipients  of 
prenatal  care  in  a  low-income,  neighborhood  clinic,  and  interviews  were  done  prenatally  by  a 
social  worker.  The  Family  Stress  Checklist  consists  of  10  items  with  a  potential  score  of  0,  5,  or 
10  for  each  item.  A  high-risk  status  was  given  to  those  obtaining  a  score  greater  than  or  equal  to 
40.  Criteria  included  childhood  care  of  the  parent  (i.e.,  whether  there  was  abuse  or  neglect  of  the 
parent  as  a  child),  the  parent’s  history  of  maltreatment  of  previous  children,  mental  illness  or 
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criminal  history,  low  self-esteem,  social  isolation  or  depression,  environmental  stress,  history  of 
violence,  unrealistic  expectations  of  the  child,  harsh  punishment  of  the  child,  child  considered 
difficult  and  unwanted  child  or  poor  bonding.  Of  the  587  children  in  the  population,  7.2%  were 
considered  high  risk.  The  outcomes  were  based  on  abuse,  neglect  or  failure-to-thrive  noted  in 
medical  records,  and  the  children  were  followed  for  1-2  years;  6.3%  of  the  population  had  a 
positive  outcome  (PPV=52.6%,  sensitivity  =  54.1%  and  specificity  =  96.7%)  (24). 

There  were  several  problems  with  this  study.  First,  according  to  Leventhal  (1988): 
“neglect  was  so  broadly  defined  that  accident-prone  children  were  included  in  the  category  of 
neglect.  The  use  of  such  a  broad  definition  likely  resulted  in  an  inflated  rate  of  maltreatment” 
(20). 

Second,  assessment  of  maltreatment  was  not  blinded.  Although  the  reviewers  of  the 
records  did  not  know  the  risk  status,  their  knowledge  of  the  child’s  past  medical  history, 
including  perinatal  events,  may  have  had  an  impact  on  assessment  of  injury  events  (25). 

Browne  and  Saqi  (1988)  conducted  a  prospective  study  over  a  period  of  2  years  to  test  the 
predictive  validity  of  a  checklist  of  13  risk  factors.  This  checklist  had  been  developed  by 
Browne  and  Stevenson  (1983)  using  a  case-control  study  (5).  The  mothers  of  14,283  newborns  in 
the  county  of  Surrey  in  England  were  evaluated  using  the  checklist  in  the  postpartum  period. 
Nine  hundred  and  forty-nine  (6.7%)  were  found  to  be  at  high  risk  of  abuse.  The  assessment  was 
based  on  the  mother's  attitude  towards  the  child,  history  of  family  violence,  socioeconomic 
markers,  prematurity/low  birth  weight,  history  of  the  parent  being  abused  or  neglected,  presence 
of  step-parent,  maternal  age  <21,  marital  instability,  psychiatric  history /substance  abuse, 
separation  of  mother  from  infant  for  >24  hours  after  delivery,  handicapped  child,  <18  month 
spacing  between  births  of  siblings,  bottle  feeding.  Of  note,  the  retrospective  study  had 
determined  that  the  attitude  towards  the  child  was  the  best  predictor,  and  that  absence  of  breast¬ 
feeding,  minimal  spacing  between  births  and  the  child  being  handicapped  were  poor  predictors. 
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Outcomes  were  based  on  case  conference  discussions  of  actual  maltreatment,  suspected 
maltreatment,  or  being  at  high  risk  of  maltreatment.  The  children  were  to  be  followed  until  their 
fifth  birthday  but  only  data  up  to  the  second  birthday  were  presented.  Of  the  high-risk  families, 
6%  were  found  to  have  maltreated  their  children  by  their  second  birthday,  compared  to  0.2%  of 
the  low  risk  families  (PPV=  6%,  sensitivity  =  67%,  specificity  =  94%)  (28).  Since  suspected 
cases  of  maltreatment  and  children  considered  at  risk  were  considered  a  positive  outcome  on  the 
sole  basis  of  the  case  being  discussed  at  case  conference,  the  true  predictive  value  of  the  study  is 
even  less.  If  only  actual  cases  of  maltreatment  were  considered  as  outcomes,  the  PPV  would  be 
2.8%,  sensitivity  33%  and  specificity  93%. 

The  socioeconomic  status  of  the  population  was  not  clearly  defined.  The  poor  predictive 
accuracy  of  the  instrument  may  have  been  due  to  the  low  prevalence  of  child  abuse.  However, 
the  authors  acknowledged  that  even  so,  the  number  should  have  been  higher  since  one-third  of 
the  abused  children  in  the  Surrey  area  were  maltreated  before  the  age  of  two  years  (5).  They 
suggested  that  the  low  prevalence  of  child  abuse  would  yield  a  large  number  of  false  positives 
and  therefore  a  second  screening  procedure  for  the  high-risk  families  may  be  needed  to 
distinguish  further  truly  potential  maltreaters.  Heifer  (1977)  addressed  this  issue  of  whether  this 
was  possible,  and  wrote:"....  it  would  appear  that  to  separate  out  potentially  abusive  or  neglectful 
parents  from  those  who  fall  into  the  more  general  high  risk  category  will  be  most  difficult."  (13). 
The  poor  predictive  accuracy  may  also  have  been  secondary  to  use  of  poor  predictors  such  as 
breast-feeding,  spacing  of  siblings  and  socioeconomic  markers. 

Although  each  of  the  studies  reviewed  had  unique  limitations,  there  were  problems  that 
were  common  to  more  than  one  study.  First,  the  children  were  not  followed  for  an  adequate 
length  of  time.  The  validity  of  the  tests  may  have  been  maximized  by  following  the  children  for 
a  longer  time  since  most  abuse  tends  to  occur  during  the  first  five  years  of  life  (1). 

Second,  some  studies  (  Lealman,  et  al;  Browne  and  Saqi;  Gray,  et  al)  (5,  12,  19)  did  not 
indicate  the  socioeconomic  status  of  the  population.  Populations  with  lower  socioeconomic 
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status  tend  to  have  higher  percentages  of  risk  factors  for  maltreatment  such  as  lower  maternal 
age,  poor  prenatal  care  and  parental  drug  use,  and  consequently  higher  rates  of  maltreatment  than 
a  population  that  samples  different  social  classes.  It  is  helpful  when  screening  for  high-risk 
individuals  to  test  the  instrument  in  the  appropriate  setting  as  the  predictive  validity  may  be 
affected.  For  instance,  if  the  population  being  examined  is  predominantly  middle  and  higher 
income,  the  predictive  validity  of  a  screening  test  may  be  poor  since  the  prevalence  of 
maltreatment  is  probably  low  within  that  population.  We  hope  that  this  study  will  be  an 
improvement  on  the  reviewed  studies  in  correctly  identifying  the  high  risk  group  and  therefore 
allocating  services  to  families  who  are  most  in  need.  This  would  be  reflected  in  a  higher  positive 
predictive  accuracy  as  a  higher  percentage  of  the  high-risk  group  would  be  subsequently 
maltreated,  and  a  better  sensitivity  as  a  greater  percentage  of  the  maltreated  children  would  be  in 
the  high  risk  group. 

While  it  is  useful  to  itemize  risk  factors  in  an  attempt  to  identify  high-risk  children,  one 
should  be  mindful  that  many  risk  factors  are  inter-related.  It  has  been  established  through  studies 
that  children  of  young  mothers  are  at  risk  of  maltreatment  (32).  A  recent  study  showed  that 
children  bom  to  young,  unmarried,  undereducated  mothers  were  more  likely  to  be  killed  when 
compared  to  children  of  mothers  who  did  not  fit  this  profile  (10).  Most  likely,  this  is  related  to 
the  psychosocial  and  economic  issues  that  often  affect  young  mothers.  "Compared  with  older 
mothers,  they  are  more  likely  to  be  poor,  undereducated,  and  underemployed."  "Many  come  from 
socially  chaotic  and  sometimes  violent  households"  (10).  Young  mothers  may  not,  by  virtue  of 
their  age,  be  able  to  have  nurturing  interactions  with  a  newborn  baby,  and  they  are  less  able  to 
access  social  networks.  Impoverished  people  tend  to  have  higher  levels  of  adolescent  pregnancy, 
and  fewer  resources  at  the  outset  to  care  for  a  child.  Further,  they  tend  to  have  higher  rates  of 
some  psychiatric  disorders. 
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The  Kung-Leventhal  Scale 

The  Kung-Leventhal  (K-L)  scale  is  a  screening  instrument  that  was  developed  in  1989  by 
Kung  and  Leventhal,  in  an  effort  to  use  structured  clinical  judgment  to  predict  children  at  risk  of 
maltreatment.  The  instrument  consists  of  22  variables  considered  to  be  important  in  evaluating 
risk  status.  Variables  studied  included  maternal  age,  past  history  of  care  of  other  children,  level 
of  intelligence,  psychiatric  history,  history  of  substance  use,  criminal  offenses,  and  violence, 
history  of  being  maltreated,  family  and  living  situation,  stability  of  relationship  with  partner, 
motivation,  characteristics  of  the  father,  social  supports,  and  provisions,  attitude  towards 
pregnancy  and  prenatal  care,  attitude  towards  newborn  including  mother’s  mindfulness  and 
interaction  with  the  newborn. 

The  K-L  scale  was  developed  with  the  intention  of  constructing  a  screening  instrument  : 
(a)  for  use  in  the  post-partum  period,  (b)  that  is  simple  and  efficient,  (c)  that  can  be  completed 
from  information  obtained  during  routine  patient  care,  (d)  that  does  not  require  use  by  specially 
trained  staff,  (e)  that  uses  structured  clinical  judgment,  assessing  the  families  for  specific 
variables  considered  to  be  risk  factors  for  abuse  and  neglect.  Importantly,  the  form  can  be 
completed  by  a  hospital  clinician,  such  as  a  doctor,  nurse  or  social  worker,  as  part  of  routine 
perinatal  care  of  the  mother  and  child. 

The  K-L  scale  addresses  the  previously  addressed  concerns  with  other  screening 
instruments.  First,  it  can  be  used  during  the  postpartum  period  and  thus,  would  be  useful  to 
identify  those  at  risk  and  ensure  implementation  of  early  prevention  measures.  Second,  it  uses  a 
structured  clinical  judgment  in  a  form  that  is  easily  completed  if  a  good  history  is  taken.  Third, 
no  particular  expert  training  is  required  to  use  the  instrument.  Finally,  risk  factors  generally 
accepted  to  be  important  in  the  epidemiology  of  child  maltreatment  were  used. 
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I:  Evaluating  the  Kung-Leventhal  Scale 

The  instrument  was  used  to  evaluate  363  consecutive  newborns  and  their  families  over  a 
one-year  period.  In  this  thesis,  data  were  collected  on  a  sample  of  these  newborns  to  examine  the 
predictive  validity  of  the  K-L  scale. 

In  evaluating  the  predictive  ability  of  the  K-L,  an  unbiased  approach  must  be  pursued. 
Such  an  approach  includes: 

(1)  minimizing  biases  due  to  detection,  that  is,  assessment  of  maltreatment  must  be  made  with 
the  reviewer  having  no  knowledge  of  the  child’s  past  medical  history  or  the  risk  status.  High- 
risk  families  may  be  followed  more  closely  and  judged  more  severely. 

(2)  using  a  sensible  definition  of  maltreatment  so  that  the  incidence  rate  will  not  be  falsely 
inflated. 

(3)  reviewing  medical  records  for  reports  of  events.  The  alternative  would  be  to  assess 
maltreatment  based  on  reports  to  the  child  abuse  registry.  This  is  unacceptable  because  of 
detection  biases,  such  as  that  outlined  previously. 

For  a  screening  instrument  to  be  a  valid  tool  in  identification  of  at-risk  children,  it  should 
have  good  sensitivity  and  specificity.  More  importantly,  a  clinician  would  need  to  know  that  if 
the  instrument  indicates  an  at-risk  child,  then  it  most  likely  means  the  child  will  be  maltreated. 
Therefore,  the  positive  predictive  value  (PPV)  needs  to  be  good  for  the  tool  to  be  of  clinical  use. 
The  following  section  outlines  the  methods  used  to  gather  data  about  the  infants  enrolled  in  the 
original  study  conducted  by  Ihnat,  et  al  (15). 
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Statement  of  Purpose 

In  1989,  Kung  and  Leventhal  undertook  a  project  to  standardize  clinical  judgment  of  the 
risk  of  child  maltreatment  in  the  perinatal  period.  The  original  goal  of  the  project  was  to  develop 
an  instrument  that  could  be  used  for  routine  screening  of  families  of  newborns.  This  instrument 
would  help  to  identify  in  the  post-partum  period,  those  at  risk  of  maltreatment  in  populations 
such  as  that  in  New  Haven.  To  achieve  this  goal,  the  instrument  needs  to  be:  "non-threatening  to 
the  patients  and  fairly  easy  to  complete  with  high  predictive  accuracy,  sensitivity,  and 
specificity. "(15)  They  developed  a  clinical  rating  scale  that  was  found  to  have  good  inter-rater 
reliability  when  non-experts  used  the  scale  and  their  judgments  were  compared  with  those  of  the 
experts.  However,  there  have  been  no  data  available  that  address  the  predictive  validity  of  the 
scale. 

Therefore,  the  purpose  of  this  study  is: 

(a)  To  determine  the  scale's  predictive  accuracy; 
and 

(b)  To  determine  the  sensitivity  and  specificity  of  the  scale. 
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Methods 

This  study  was  conducted  in  two  phases.  The  first  phase  began  in  1989  with  work  done 
by  Denise  Kung  Ihnat  in  the  development  and  testing  of  the  screening  instrument.  The  second 
phase  is  the  testing  of  predictive  validity. 

The  first  phase  of  the  study  involved  constructing  the  screening  instrument,  the  K-L, 
pilot-testing,  testing  of  inter-rater  reliability,  and  field  testing  of  the  instrument.  A  model  of 
developing  an  observational  scale  for  assessing  the  severity  of  illness  in  a  febrile  child,  studied 
by  McCarthy,  was  used  as  the  basis  for  a  later  study  by  Leventhal,  Feam  and  Stash  wick.  This 
study  showed  that  pediatric  residents  at  the  Yale-New  Haven  Hospital  relied  mostly  on 
observations  of  the  mother,  interactions  between  mother  and  baby,  and  information  gleaned  from 
the  history,  in  assessing  parenting  skills.  In  a  later  study  conducted  by  Leventhal,  Garber  and 
Brady  (1989),  a  group  of  children  categorized  as  high  risk  based  on  unstructured  clinical 
evaluation,  was  studied  for  subsequent  maltreatment  (22).  A  list  of  factors  used  to  identify  those 
high-risk  children  during  the  postpartum  period  was  compiled  and  used  initially  as  the  risk 
factors  on  the  K-L. 

The  K-L  was  pilot-tested  using  176  subjects.  The  families  were  assessed  for  risk  of 
maltreatment  by  the  nurse,  pediatrician  or  social  worker.  The  clinicians  were  required  to 
complete  the  K-L  and  a  global  rating  scale  (GRS),  which  assessed  risk  based  on  unstructured 
clinical  judgment  (Figures  1  and  2).  Clinicians  were  also  asked  to  provide  suggestions  regarding 
additions  or  deletions  of  variables  on  the  K-L. 

Thirty-two  infants  and  their  mothers  were  then  evaluated  by  experts  and  non-experts  in  the  area 
of  child  maltreatment  using  the  GRS.  The  consensus  rating  of  the  experts  was  used  as  the  gold 
standard  for  prediction  of  maltreatment.  The  K-L  was  then  tested  for  concurrent  validity  between 
the  experts  and  for  consensual  validity  between  non-experts’  K-L  rating  and  the  gold  standard. 
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Figure  1 

Version  7-  Kung/Leventhal  Parenting  Skills  Form 


Kung<l9V«nthal  Parenting  Skills  Forci  Daw _ Ctecon _ 

UoAantNansUrvif _ _ _OjkfsNamaUnit*. 


For  Bach  ot  th«  items  on  the  left,  please  malt  ti9  statement  to  tlw  nght  tvat,  r  yoia  bast  judgment,  *  most  axurate  K  mom  tun  one  stotemam  appeae.  mark  the  statement  tie!  is  hrthest  to  tie 
right.  Answer  a!  questions  indutSnj  the  overaS  rating  ol  nsk 

NO  PROBLEM  MILD  MODERATE  SEVERE 


CARE  OF  OLDER 

sias 

1.  Past  History 

Unk 

Pnmip 

No  problems  with  cars 

Poor  weft-child  care 
(eg.  missed  appta) 

Suspicion  of  abuse  or 
neglect 

Verified  abuse,  nog.  or  tailure- 

to-tfvrve  OR  placement 

MOTHER 

2.  Intelligence 

Unk 

No  concerns ;  functions  well 

Stow;  llmiled  tiiWurg 

retarded 

Mode. arefy/ severely  retarded 

3.  Psychiatric  History 

Unk 

No  prior  hlsto'Y  or  arrant 

symptoms 

Mikj  (e  g.  anxiety, 
depression) 

Past  pysch  hoep.  admission 
or  current  pysch  drug  use 

Major  (eg  psychosis,  major 
depression,  sufctoe  try) 

4.  licit  Drug  us® 

Unk 

No  N  story  ol  chug  use 

Used  before  prep,  none 
during  prep.  OR  slopped 
early  In  preg. 

Used  occasionally  during 
preg. 

Used  regularly  during  preg. 

3.  Atoohd  Us* 

Unk 

No  history  ol  alcohol  use 

Oar*,  before  preg,  none 
during  preg.  OR  stopped 
early  In  preg. 

Drank  oocaeonafty  during 
preg 

Drank  rag.  during  preg  or 
untreated  al acholic 

6.  Motivation 

Unk 

Uses  resources;  seeks  help 
as  needed 

Seeks  help  once 
encouraged  »  do  to 

Slow  D  address  problarra 

Denies  problems;  resists  help 

7.  Crirrenad  Record 

Unk 

No  criminal  record 

Has  been  charged  but 
never  convicted 

Currency  has  chorgoe 
pending 

Has  been  convicted  OR  )e3 
stay  now  or  in  pest 

8.  History  of  Vkslonoo 

Unk 

Appropriate  levels  of  anger 

Rare  Ihreet  ening  verbal 
outbursts  only 

Frequent  physical  or  verbal 
outbursts 

A  past  victim  has  needed 
modkeal  care 

9.  Vofhor'i  Caro  as  a 
ChW 

Unk 

No  history  of  abuse  or 
neglect 

Poor  nurturance  (e  g. 
troq.  change  in  care) 

History  d  abuse  or  neglect 

Spent  time  in  foster  care 

20.  Age 

link 

>11  at  birth  or  Erst  child 

Now  >  l  *.  but  ww  <  1 »  at 
Nr*  of  (lr«t  child  ~ 

Now  £18  years  old.  but  >15 
yscs  old 

Now  05  years  old 

CURRENT  PARTNER 

II.  Gen.  Character 

Unk 

No  concerns  —  is 
appropriate 

No  men  is  Involved 

Man  involved  has  past  prob. 

In  any  areas  12-10 

Man  invotved  has  currant  prob. 
in  any  aruas  #2-10 

CURRENT  FAMILY 
ll  Famiy  Conflict? 
Partner  Con&ci 

Unk 

None  or  mid 

Discord  vrfth  some  bitter 
arguing 

Strong  discord  but  no 
violence 

Physical  vidaoca  In  family 

13.  Stabifity  ol  Couple 

Unk 

No 

partner 

Stable 

Couple's  relationship 
unstable 

Boyfriends  change  often 

Absence  ol  stable  relationships 

14,  Housing 

Unk 

Sale  and  adequate 

Unsa't  or  overcrowded 
boma 

live  In  temporary  aho'tar 

Uva  on  street/ abandoned 

boltings 

IS.  Provisions  for  Bafcy 

Unk 

Have  necessities 

Have  kmited  necessibes 
(e.g.  Oothes,  crib) 

Unprepared  lor  baby 

Parents  unaware  of  needs  of 
baby  and  unprepared 

16.  Scoal  Supports 

Unk 

Family  or  Maxis  ava&bie 
rogukuiy 

Fam4y  or  blends 
available  occastonaTy 

Family. -friends  avail  onfy  h 
emergency 

No  femiy/fnends  avail  to  help. 

ever 

CURRENT  PREG. 

17.  Altitude 

Unk 

Pregnancy  planned  and 
wanted 

Unplanned  preg.  but 
baby  wanted 

Abortion  or  adoption  w as 
considered 

Dislikes  pregnancy  or  baby 

IS.  Prenatal  Care 

Unk 

Regular  and  began  in  the 
first  rim  ester 

Regular  and  began  in 
the  second  trimester 

Began  in  thud  trim.  OR  trreg. 
attendance 

No  prenatal  care 

CURRENT 

BEHAVIORS 

19.  Care  ot  Newborn 

Unk 

Mom  RnentNs  and 
approprtaie  with  baby 

Concerns  about 

Interactive  style 

Ignores  baby's  needs  often 
but  interacts  some 

Usually  tpnorai  baby  OR 
snlNaca  sBkfom 

20.  Vialtang  with  Baby 

Unk 

Mom  w<baby  constantly 
(deify  «f  in  NBSCU) 

Mom  w/baOy  >\n  the 
day  (every  1-2  days  If 
NGSCU) 

Visits  <lft  fre  day  0-2  times 
a  week  if  NBSCU) 

Reluctant  or  refuses  id  see 
baby 

21  CoGperanvenass 

Unk 

Ccoperates  with  hospital 
staff 

Resists  mad  cal  care  or 
GdYlce 

Tries  to  leave  with  baby 

AfM 

TTveateftS  o.  Pies  to  harm  5BH 

22.  Dang  or  of  chid 

Unk 

Mom  mindful  of  baby’s 
safety 

Unlntonbonrtify  not 
careful 

Places  baby  In  obvious 
danger  OR  not  careful 

Mother  harms  baby 

••Please  complete  the  following  statement  by  cutting  the  phrase  in  bold  that  you  feel  it  is  most  accurate  I  think  that  this  hahy  u  at' 
HIGH  RISK  /  MODERATE  RISK  /  LOW  RISK  /  NO  RISK  being  abused  or  neglected  sometime  in  the  future. 
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Figure  2 


Version  2-  Global  Rating  Scale 

Based  on  your  clinical  judgment  and  your  interactions  with  this  newborn's  family,  please  mark 
the  one  statement  below  which  you  feel  is  most  accurate. 


_  I  am  fairly  certain  that  this  child  will  be  abused  or  neglected;  this  family  definitely  needs 

assistance  from  Social  Services  (e.g.  parenting  classes,  support  groups,  assistance). 

_  I  am  concerned  that  this  child  might  be  abused  or  neglected,  and  I  feel  that  this  family 

will  need  some  assistance  from  Social  Services. 


_  I  feel  that  there’s  a  chance  this  child  will  be  abused  or  neglected,  but  I  don’t  feel  that 

intervention  is  warranted  at  this  time. 


I  feel  that  this  child  will  not  be  abused  or  neglected. 
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The  K-L  underwent  six  revisions  during  and  after  the  pilot  study.  Revisions  were  made 
by  rewording  titles  and  examples  and  by  converting  individual  scales  to  4-point  scales  for  each 
item  on  the  K-L.  The  variables  used  in  the  final  revision  were  included  after  evidence  of 
research  supporting  them  as  risk  factors  for  maltreatment.  For  each  item  there  were  the 
following  ratings:  unknown,  no  risk,  low  risk,  moderate  risk,  high-risk  trait.  A  final  evaluation 
was  made  which  assigned  the  infants  a  numerical  score  and  a  global  rating  of  no  risk,  low  risk, 
moderate  risk,  or  high-risk  category.  A  scoring  method  was  developed  which  produced  the  best 
differentiation  between  the  no/low  risk  group  and  the  moderate/high  risk  group. 

Between  November  1989  and  September  1990,  the  mothers  of  363  consecutive  newborns 
at  Yale-New  Haven  Hospital  were  evaluated  using  the  K-L  scale  in  the  postpartum  period.  Two 
hundred  and  ninety-three  of  these  forms  were  completed  and  returned. 

The  second  phase  of  this  study  began  in  1996,  and  is  presented  in  this  thesis.  In 
summary,  the  predictive  validity  of  the  Kung-Leventhal  scale  was  tested  to  determine  the 
occurrence  of  maltreatment  between  the  ages  of  0-4  years.  Each  of  the  completed  K-L  forms 
was  reviewed  to  determine  their  eligibility  for  a  predictive  validity  study  of  the  K-L  scale.  All 
the  eligible  moderate/high  risk  subjects  were  selected,  and  a  random  sample  of  the  no/low  risk 
subjects  was  selected  for  comparison.  The  children’s  medical  charts  were  then  reviewed  from 
birth  to  the  fourth  birthday. 


Scoring  of  the  Kung-Leventhal  Scale 

Each  item  on  the  Kung-Leventhal  parenting  skills  form  was  given  a  numerical  score. 
Items  that  were  unknown  and  no-risk  behaviors  were  given  a  score  of  zero,  low-risk  a  score  of 
one,  moderate  risk  a  score  of  two,  and  high  risk  a  score  of  three.  An  arithmetic  sum  of  the  scores 
was  given,  and  scores  >9  assigned  subjects  to  the  moderate/high  risk  category. 

For  an  infant’s  form  to  be  included  in  this  cohort,  the  K-L  had  to  meet  the  following  two  criteria: 
(1)  greater  than  16  of  the  22  items  on  the  K-L  form  had  to  have  been  completed 


AND 
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(2)  the  forms  had  to  have  been  filled  out  by  a  social  worker  or  a  doctor. 

Selection  of  patients  for  predictive  validity 

All  of  the  moderate/high  risk  infants  who  were  eligible  for  being  scored  were  selected  for 
the  study  of  the  predictive  validity  of  the  K-L  scale.  Using  a  Random  Numbers  Table,  patients 
were  randomly  selected  from  the  no/low  risk  category  for  comparison  in  the  following  way: 

A  random  number  that  turned  out  to  be  an  even  number  was  selected  from  the  random  tables. 
Subsequently,  subjects  were  arranged  by  chronological  birthdates,  and  consecutively  selected  if 
they  corresponded  with  an  even  number,  moving  along  the  columns  of  the  random  numbers 
table.  For  example,  if  there  were  3  subjects  bom  on  November  1st,  2nd  and  3rd,  and  the  first 
random  number  was  odd,  the  first  subject  was  omitted.  If  the  following  random  numbers  were 
both  even,  then  the  following  2  subjects  were  included. 

Eligibility  for  chart  review 

Subjects  were  excluded  from  the  process  of  chart  reviews  if:  (i)  they  were  adopted  or  sent 
to  a  foster  home  in  the  perinatal  period  or  (ii)  if  they  had  less  than  one  visit  at  the  health  care 
sites  monitored  for  this  project  (Yale-New  Haven  Hospital,  Fair  Haven  Health  Center,  Hill 
Health  Center  and  Hospital  of  St.  Raphael).  Therefore,  we  reviewed  the  medical  records  of  a 
sample  of  92  eligible  children  from  0-4  years  of  age.  We  requested,  and  were  granted  permission 
to  gather  information  from  the  children’s  medical  charts  at  Yale-New  Haven  Hospital,  Hospital 
of  St.  Raphael’s,  Hill  Health  Center,  and  Fair  Haven  Community  Health  Center.  These  are  the  4 
major  health  facilities  for  children  in  the  New  Haven  area. 

Outcomes 

The  medical  records  were  reviewed  for  any  episodes  of  injury.  Using  pre-defined 
criteria,  two  reviewers  evaluated  outcomes  based  on:  (a)  maltreatment,  (b)  failure  to  thrive,  and 
(c)  changes  in  the  child's  caretaker. 
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Clinical  data  was  abstracted  by  one  reviewer  from  birth  to  the  child’s  fourth  birthday. 
The  second  reviewer  was  blind  to  the  patient’s  risk  status  and  demographics  to  minimize 
detection  bias.  This  reviewer  was  given  a  succinct  outline  of  any  injury  episodes.  An  injury 
event  did  not  necessarily  imply  an  actual  focal  injury.  Injury  episodes  were  described  without 
specific  details  as  to  whether  it  was  considered  maltreatment  by  clinicians  caring  for  the  child. 
Information  provided  to  this  reviewer  included  the  type  of  injury,  the  area  of  the  body  where  the 
injury  occurred,  the  severity  of  the  injury,  and  whether  the  child  was  hospitalized  for  the  injury. 
Both  reviewers  then  classified  events  as  definite  abuse,  probable  abuse,  questionable  abuse, 
physical  neglect,  supervisional  neglect,  health  neglect,  abandonment,  accident/neglect, 
unintentional  injury,  definite  sexual  abuse,  probable  sexual  abuse,  questionable  sexual  abuse, 
household  violence,  motor  vehicle  accident. 

Maltreatment  was  defined  as  abuse  (definite  or  probable  physical  abuse),  neglect 
(physical,  medical  or  supervisional),  or  abandonment.  Outcomes  were  defined  according  to  the 
criteria  developed  by  Stier  and  Leventhal  in  1988.  Physical  abuse  was  defined  as  evidence 
indicating  physical  pain  or  harm  that  was  caused  intentionally.  This  outcome  had  specific  criteria 
based  on  the  evidence  from  physical  and  radiologic  exam  as  well  as  the  history,  which  defined 
the  levels  of  certainty  of  abuse.  Sexual  abuse  was  defined  as  medical  findings  and  or  combined 
history  and  medical  findings  indicating  inappropriate  sexual  contact.  Neglect  was  defined  as 
evidence  indicating  a  lack  of  reasonable  attempts  to  provide  food,  shelter,  clothing,  proper  health 
care  resulting  in  preventable  injury  or  disease  or  adequate  supervision  resulting  in  an  injury  not 
suspected  to  be  intentional. 

Failure  to  thrive  was  defined  as  documented  concern  by  a  physician  about  height  and/or 
weight  below  the  5th  percentile  or  a  drop  in  two  percentiles  for  age,  gender  and  gestational  age 
secondary  to  psychosocial  factors,  with  or  without  an  organic  component. 

A  major  change  in  the  caretaker  was  defined  as  an  outcome  if  there  was  documented 
proof  of:  (1)  placement  via  the  child  protection  agency  or  other  means,  into  a  home  other  than 
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that  of  the  parents  or  (2)  a  change  in  the  primary  caregiver  based  on  the  caregiver's  assuming 
responsibility  for  taking  the  child  to  the  clinic  and  provision  of  the  child's  basic  needs. 

Referrals  made  to  the  state’s  child  protection  agency  and  immunization  delay  were  also 
examined. 


Abstraction  of  other  data 

Information  also  was  obtained  regarding  the  mother's  age,  race,  parity,  social  situation 
(including  stability  of  the  relationship  with  the  father  of  baby  or  current  partner)  ,  substance 
abuse  (past  or  current)  ,  history  of  violence,  the  baby's  perinatal  characteristics,  immunizations, 
missed  appointments,  developmental  delay,  visits  to  the  primary  care  clinic,  and  emergency 
room,  and  interventions  that  may  have  been  made  from  birth  to  the  end  point  of  the  study. 

Analysis 

The  relative  risk  ratios  were  calculated  to  compare  the  occurrence  of  outcomes  in  the 
moderate/high  risk  group  and  the  no/low  risk  group.  Chi-square  tests  were  used  to  determine  the 
statistical  significance  of  the  difference  between  the  groups.  The  predictive  ability  of  the  Kung- 
Leventhal  scale  was  compared  with  the  global  rating  scale  (GRS),  which  used  unstructured 
clinical  judgment  to  determine  risk  status.  Finally,  categories  of  items  and  individual  items  on 
the  K-L  were  assessed  for  their  ability  to  predict  maltreatment. 

Since  a  random  sample  of  50  was  selected  from  an  initial  no/low  risk  group  of  109 
eligible  infants,  the  numbers  were  weighted  to  calculate  PPV,  sensitivity  and  specificity  based  on 
the  initial  number  of  low  risk  infants.  This  weighting  was  done  in  assessing  the  K-L  as  a  whole, 
as  well  as  assessing  the  categories  and  individual  items  on  the  K-L. 
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Work  done  by  the  author 

The  scoring  of  all  the  K-L  forms  and  identification  of  subjects  for  the  study  were  done  by 
the  author.  Abstraction  of  all  charts  was  also  conducted  by  the  author.  (The  abstraction  form 
was  developed  by  Dr.  Ihnat).  Ratings  of  the  injury  events  were  done  by  the  author  and  Dr. 
Leventhal.  The  database  was  developed  by  the  author.  Approximately  30%  of  the  analyses  were 
conducted  by  the  author  alone,  and  70%  with  the  assistance  of  Dr.  Cohen. 
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Results 

Of  the  293  K-L  forms  that  were  completed  and  returned,  159  infants  fulfilled  the 
inclusion  criteria  for  scoring.  Of  the  patients  who  did  not  meet  the  inclusion  criteria,  all  had 
forms  filled  out  by  a  social  worker  or  a  doctor  but  all  had  less  than  16  items  completed  on  the  K- 
L  form. 

Based  on  the  scores  of  the  eligible  infants,  50  subjects  were  placed  in  the  moderate/high- 
risk  category  and  109  were  categorized  as  no/low  risk.  Fifty  patients  in  the  no/low  risk  category 
were  randomly  selected  for  comparison  to  subjects  in  the  moderate/high-risk  group. 
Subsequently,  8  children  were  found  to  be  ineligible  for  the  study  since  they  had  not  been  seen  at 
any  of  the  four  major  health  care  facilities  in  New  Haven  for  primary  or  emergency  care  (5  from 
the  moderate/high  risk  category  and  3  from  the  no/low  risk  category)  and  3  others  were  excluded 
because  of  adoption  at  birth  or  placement  at  birth  into  foster  care  (all  from  the  high-risk  group). 
Of  the  92  eligible  children,  42  were  in  the  moderate/high  risk  category,  47  were  in  the  no/low 
risk  category. 

The  population  examined  was  overwhelmingly  derived  from  the  lower  socio-economic 
groups  with  79%  using  state  entitlements  (Title  19)  for  health  care.  The  majority  of  mothers 
were  single  (77%),  with  a  mean  age  of  24,  and  had  at  least  one  child  prior  to  the  current 
pregnancy. 

The  differences  between  both  groups  were  not  statistically  significant  with  respect  to  sex, 
race,  method  of  payment,  and  the  mother’s  education.  Parity  >3,  documented  abuse  or  neglect  of 
previous  children,  maternal  drug  use,  alcohol  use  during  pregnancy,  consultation  by  the  hospital 
social  worker,  registration  for  prenatal  care  later  than  the  second  trimester,  family 
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Table  1 

Baseline  Characteristics 


% 

% 

Variables 

Moderate/High  risk 
N=42 

No/Low  risk 
N=102 

p 

Gender:  male 

61.9 

51.1 

NS 

Race 

Black 

61.9 

63.8 

NS 

White 

26.2 

17.0 

Hispanic 

11.9 

19.1 

Method  of  Payment:  Title  19 

81.0 

76.6 

NS 

Education:  High  school  drop-out/in  high  school 

38.1 

;  . ,  . 

27.7 

NS 

Maternal  age  <20  yrs 

31.0 

31.9 

NS 

Gestational  age  <37  wks 

19.0 

8.51 

NS 

Marital  status:  single 

95.2 

78.7 

<0.05 

Parity  >3 

14  ...  •  '  jl.Wl  ..  4 . 1  w  4.  ,  »  V-  ...■ .  ... : 

42.9 

14.9 

<0.01 

M>#4i  ... 

Documented  maltreatment  of  previous  children 

21.4 

2.13 

<0.01 

Drug  use 

57.1 

8.51 

l  "lit 

<0.0001 

Alcohol  use  during  pregnancy 

26.2 

4.26 

<0.01 

Housing  problems 

19.0 

8.51 

NS 

Social  work  consult  in  postpartum  period 

97.6 

57.4 

<0.0001 

No  prenatal  care  or  onset  in  3rd  trimester 

42.9 

>>  '2 22. .;y.  Lja  -.2. .  w. .  $ 

10.6 

<0.001 

Family  conflict 

23.8 

4.26 

<0.01 

Social  supports 

Js  »  >  „  „  ’  .vi •  r  < * » ' ssys  $ 

m  mm  %;  >  mmm  as  &  :r  :  s  >  mi  r&sm  m mm 

14.3 

0 

<0.01 

'j&'y. ski 

conflict  and  lack  of  social  supports  were  all  recorded  more  frequently  in  the  medical  records  of 
the  moderate/high  risk  infants  (Table  1). 

Scores  on  the  K-L  ranged  from  9-38  for  the  moderate/high  risk  group  and  0-8  for  the 
no/low  risk  group.  The  infants  categorized  as  moderate/high  risk  had  an  average  score  of  16, 
with  a  mode  of  13;  the  no/low  risk  infants  had  an  average  score  of  4,  with  a  mode  of  5. 

The  average  number  of  visits  to  the  primary  care  center  in  the  first  year  of  life  was  6,  with 
both  groups  averaging  a  similar  number  of  visits  during  that  time.  Both  groups  also  had  similar 
intensity  of  follow-up  with  similar  average  lengths  of  follow-up  (32  months  in  the  no  /low  risk 
group,  and  34  months  in  the  moderate/high  risk  group). 
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Major  Outcomes  (Table  2) 

Maltreatment  (defined  as  abuse,  neglect  or  abandonment)  occurred  in  28.6%  of  the 
moderate/high  risk  infants  vs  8.5%  of  the  low  risk  infants  (RR=  3.36,  CI=  1.17,  9.62;  p=0.013). 
Whereas  1 1 .9%  of  the  moderate/high  risk  children  were  maltreated  in  the  first  year  of  life,  none 
of  the  no/low  risk  infants  had  been  maltreated.  Further,  23.8%  of  the  moderate/high  risk  infants 
had  experienced  an  episode  of  maltreatment  by  the  age  of  2  years  vs  8.5%  of  the  no/low  risk 
group. 

Of  the  moderate/high  risk  children,  23.8%  had  a  major  change  in  caretaker  vs  2.1%  of 
no/low  risk  children  (RR=11.20,  CI=  1.50,  83.78;  p=0.001).  In  9.5%  of  the  moderate/high  risk 
group,  the  change  in  caretaker  was  due  to  placement  outside  the  home,  and  in  14.3%  the  child 
was  cared  for  by  a  relative. 

The  differences  in  growth  concerns  between  the  two  groups  were  not  statistically 
significant  (RR=1.49,  CI=  0.35,  6.29;  p=  NS). 

At  least  one  major  outcome  (maltreatment,  major  change  in  caretaker  or  growth  concern) 
occurred  in  38.1%  of  the  moderate/high  risk  group  vs  14.9%  of  the  no/low  risk  group  (RR=  2.56, 
Cl=  1.17,  5.61;  p=0.012). 


30 


Table  2 

Comparison  of  Outcomes 


No.  of 
events 


Outcome 

High  risk 

Low  risk 

%  High 
risk 

%  Low 
risk 

Relative  Risk 

Confidence 

interval 

P 

Maltreatment 

13 

4 

28.6 

8.5 

3.36 

1.17,  9.62 

0.013 

Abuse 

1 

0 

2.4 

0.0 

NS 

Neglect 

6 

4 

14.3 

8.5 

1.72 

0.52,  5.67 

NS 

Abandonment 

6 

0 

14.3 

0.0 

<0.01 

Major  change  in  caretaker 

10 

1 

23.8 

2.1 

11.19 

1.50,  83.78 

0.001 

Change  of  guardian 

6 

0 

14.3 

0 

<0.01 

Placement  outside  the  home 

4 

l 

9.5 

2.1 

4.48 

0.52,38.48 

NS 

Growth  concerns 

4 

3 

9.5 

6.4 

1.12 

0.30, 4.20 

NS 

At  least  one  major  outcome 

27 

8 

•ffstilllSli 

38.1 

14.9 

2.56 

1.17,5.61 

0.012 

Household  Violence 

0 

0 

0 

0 

0 

Accident 

18 

19 

23.8 

27.7 

0.86 

0.42, 1.75 

NS 

Neglect/accident 

13 

11 

21.4 

17.0 

1.26 

0.54,  2.97 

NS 

Referrals  to  DCF 

31 

4 

45.2 

8.5 

5.32 

1.97,  14.37 

<0.001 

at  birth 

12 

2 

28.6 

4.3 

6.71 

1.59,28.28 

0.001 

After  discharge 

19 

2 

31.0 

4.3 

7.27 

1.74,  30.38 

<0.001 

t  i-. 

Immunization  delay 

10 

6 

23.8 

12.8 

1.87 

0.74,  4.69 

NS 

Other  Outcomes 

Referrals  to  the  child  protective  services  agency  —  Department  of  Children  and  Families 
(DCF)  —  occurred  in  45.2%  of  moderate/high  risk  children  vs  8.5%  of  no/low  risk  children.  Of 
the  infants  referred  at  birth,  12  were  in  the  moderate  high-risk  group  (28.6%),  and  2  in  the  no/low 
risk  group  (4.3%).  Of  the  children  referred  between  the  time  of  discharge  from  the  hospital  and 
the  fourth  birthday,  13  were  in  the  moderate/high  risk  group  (31%),  and  2  in  the  no/low  risk 
group  (4.3%).  Six  children  in  the  moderate/high  risk  category  were  referred  at  birth  and  again 
after  discharge.  Of  the  13  moderate/high  risk  children  who  were  referred  after  discharge,  5  had 
more  than  one  referral  over  the  period  of  the  study. 

Of  the  moderate/high  risk  referrals  at  birth  (N=12),  the  most  common  reasons  cited  were 
maternal  characteristics,  for  instance  drug  and  /or  alcohol  abuse  (75%)  and  problems  with  care  of 
previous  children,  for  instance  abuse  or  neglect  of  older  siblings  (58.3%)  (Table  3a).  For  the 
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referrals  after  discharge  (N=19),  the  most  common  reasons  cited  were  problems  with  care  of  the 
current  child,  for  instance  abuse  or  neglect  (63.2%),  and  household  characteristics  such  as 
‘unstable  household’  or  ‘high-risk  home  environment’  (31.6%)  (Table  3b). 

Of  the  cases  of  moderate/high  risk  referrals  (N=19),  36.8%  resulted  in  a  change  in 
caretaker  via  DCF  vs  25%  of  the  no/low  risk  referrals  (N=4). 


Table  3a 

>m  sanf 

m  M  .fi  i 

Reasons  for  referrals  at  birth 

Referrals 

..  1  ..  ^  t  i  ^  ,  ■■ 

No. 

% 

Category 

Example 

High  risk 
N=12 

Low  risk 
N=2 

High 

risk 

Low  risk 

Maternal  characteristics 

dr  ug  abuser 

9 

I  Z'  1  I <?  1 

2 

75.0 

100 

iSlSIsSIlii 

Previous  care  of  children 

Sibling  in  foster  care 

7 

1 

58.3 

50.0 

Characteristics  of  household 

. . 

chaotic  or  unstable  household 

2 

0 

16.7 

0 

Current  behaviors 

mother  abandoned  child 

2 

0 

16.7 

0 

Current  pregnancy 

mother  ambivalent  about 
nrepnancv 

1 

0 

8.3 

0 

pregnancy 


N.B.:  a.  Clinicians  cited  several  reasons  for  referrals,  therefore  percentages  add  up  to 
More  than  1 00%. 

b.  Calculations  were  done  as  percentages  of  the  total  number  of  referrals  at 
birth. 


Table  3b 

Referrals 

Reasons  for  referrals  after  discharge 

No. 

% 

Category 

Example 

High  risk 
N=19 

Low  nsk  High  risk 
N=2 

Low  risk 

Care  of  current  child 

Abuse  or  neglect 

12 

i 

63.2 

50.0 

Characteristics  of  household 

Chaotic  or  unstable  household 

6 

0 

31.6 

0 

Maternal  characteristics 

Drug  abuser 

5 

1 

26.3 

50.0 

Current  behaviors 

Mom  abandoned  child 

4 

0 

21.1 

0 

N.B.:  Calculations  were  done  as  a  percentage  of  the  total  number  of 


Referrals  after  discharge. 

>  „  ,  ~  >  y  5 V~'  t  J.2  J.  „  t'T.  i  2.  ✓ 


Structured  clinical  judgment  using  the  K-L  scale  vs  unstructured  clinical  judgment 

The  positive  predictive  value  (PPV)  of  the  K-L  was  28.6%,  i.e.  maltreatment  occurred  in 
28.6%  of  the  moderate/high  risk  cases  (sensitivity  =  57.1%,  specificity  =  75.6%)  vs  23.8%  using 
the  risk  status  assigned  by  clinicians  using  unstructured  clinical  judgment  (sensitivity  -  47.6%, 
specificity  =  74%).  At  least  one  of  the  major  outcomes  was  predicted  in  38.1%  of  the 
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moderate/high  risk  cases  using  the  K-L  (sensitivity  =  51.6%,  specificity  -  77%)  vs  31%  using 
unstructured  clinical  judgment  (sensitivity  -  40.6%,  specificity  =  74.1%). 


Predictive  ability  of  the  items  on  the  K-L 

I:  Categories  (Tables  4a-4f) 

To  examine  groups  of  items  on  the  K-L  that  were  predictive,  we  divided  the  K-L  into  6 
categories.  Category  1  refers  to  item  1  on  the  K-L  (care  of  older  siblings).  Category  2  refers  to 
items  2-10  (maternal  characteristics)  that  include  intelligence,  psychiatric  history,  drug  use, 
alcohol  use,  motivation,  criminal  record,  history  of  violence,  care  as  a  child,  and  age.  Category  3 
refers  to  item  1 1  (characteristics  of  the  mother’s  current  partner).  Category  4  refers  to  items  12- 
lb  (family  characteristics)  that  include  family  conflict,  stability  of  the  couple,  housing, 
provisions  for  the  baby,  and  social  supports.  Category  5  refers  to  items  17-18  (current 
pregnancy)  that  include  attitude  towards  the  pregnancy  and  prenatal  care.  Finally,  category  6 
refers  to  items  1 9-22  (current  behaviors)  that  include  care  of  the  newborn,  visiting  with  the  baby, 
cooperativeness,  and  danger  to  the  infant.  A  category  was  considered  predictive  if  a  score  of  2  or 
3  was  given  for  at  least  one  item  in  that  category. 

The  categories  on  the  K-L  that  were  most  predictive  of  maltreatment  were:  (1)  past  care 
of  older  siblings  (PPV  =  40%,  sensitivity  =  19%,  specificity  =  95.1%  and  (2)  current  behaviors  of 
the  mother  (PPV=  33.3%,  sensitivity  -  14.3%,  specificity  =  95.1%).  The  most  sensitive 
categorical  indicators  of  maltreatment  were  maternal  characteristics  (sensitivity  -  61.9%,  PPV  = 
19.4%,  specificity  =  56.1%)  and  problems  with  the  current  pregnancy  (sensitivity  =  42.9%, 
PPV=  22.5%,  specificity  =  74.8%)  (Tables  4a-4f). 

The  categories  that  were  most  predictive  of  any  of  the  major  outcomes  were  prior  care  of 
older  sibs  (PPV  =  60%,  sensitivity  =  19.4%,  specificity  =  96.5%)  and  characteristics  of  the 
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current  family  (PPV  =  36.8%,  sensitivity  =  22.6%,  specificity  =  89.4%).  The  sensitivity  rose  to 
74%  for  maternal  characteristics  and  57%  for  problems  during  the  current  pregnancy  when  at 
least  one  of  the  major  outcomes  was  considered. 

II:  Individual  items 

Items  were  considered  predictive  if  a  score  of  2  or  3  was  given  for  that  item.  The  single 
item  on  the  K-L  that  was  most  predictive  of  maltreatment  was  the  existing  social  supports  (PPV= 
100%,  sensitivity  =  9.52%,  specificity  =  100%).  Of  all  the  children  who  were  maltreated,  38.1% 
of  the  mothers  had  no  prenatal  care,  or  care  that  began  in  the  third  trimester,  making  this  risk 
factor  the  single  most  sensitive  indicator  of  maltreatment  (PPV=  25%,  specificity  -  80.5%). 


Table  4a 


Category  1 

Care  of  older  sibs 

Maltreatment 

Yes 

No 

Total 

PPV=  40% 

Sensitivity  =  19% 

|K-L  1+ 

4 

6 

TO 

Specificity=  95.1% 

K-L  1- 

17 

117  134 

rrotaT~~  ~ 

21 

T2X  144 

1 

. 

Table  4b 


Category  2 

Maltreatment 

....  ....... 

PPV=  19.2% 

Maternal  characteristics 

Yes 

No 

Total 

Sensitivity-  61 .9% 

[K-L2-10+ . 

54 

67 

Specificity  =  56.1% 

K-L  2-10- 

8 

69 

77 

p'obl 

21 

T23  rw 

■ 

Table  4c 


Category  4 

Partner's  characteristics 

Maltreatment 

Yes 

No 

Total 

PPV=  29.2% 

Sensitivity=  33.3% 

J  K-L  1 1  + 

7 

W 

“24 

Specificity=  86.2% 

K-L  11- 

14 

106 

120 

JTotaT 

~~2i 

. .. ; 

nr 
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Table  4d 


Category  4 

Maltreatment 

PPV=  26.3% 

Family's  characteristics 

Yes 

No 

Total 

Sensitivity=  23.8% 

jTCTT2^T5"+ 

5 

r4 

19 

Specificity=  88.6% 

K-L  12-16  - 

16 

109 

125 

[Total 

2r 

123” 

144 

Table  4e 

Category  5 

Maltreatment 

PPV=  22.5% 

Current  pregnancy 

Yes 

No 

Total 

Sensitivity=  42.9% 

|K.-L  17TS+ 

K-L.  17-18- 

9 

12 

Tr— 

92 

40 

104 

Specificity=  74.8% 

[Totar 

1  .....  . . :  a - , - 

TT 

... 

123 

144 

_ 


PPV=  33.3% 


Table  4f 

Category6  Maltreatment  hv-jj.j/o 

Current  behaviors  of  the  mother  Yes  No  Total  Sensitivity=  14.3% 

JZUWZSF 


K-L  1 9-22+  3  6  9 

K-L 19-22-  18  117 

1  *  otd  — ™  “  2*1  144 

s  aisistt  m  'ssmsm  i  Maoism  ms s a s  ssmi  sssmsisms ... :  aaiis  s 


9  '  Specificity=  95.1% 

135 


. . . .. . . . 

Note:  Since  a  random  sample  of  50  was  selected  from  an  initial  low  risk  group  of  100  eligible  infants,  the  numbers 
were  weighted  to  calculate  PPV,  sensitivity  and  specificity  based  on  the  initial  number  of  low  risk  infants. 
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Discussion 


The  major  findings  of  this  study  are: 

a.  The  use  of  the  Kung-Leventhal  Parenting  scale  in  the  postpartum  period  accurately  predicts 
maltreatment  that  occurs  up  to  four  years  of  age  in  an  urban,  underserved  population.  Infants 
with  scores  >9  were  3.36  times  more  likely  to  be  maltreated  and  11.2  times  more  likely  to 
experience  a  change  in  caretaker  compared  with  the  no/low  risk  group.  The  outcome  of  growth 
concerns  did  not  occur  more  frequently  in  the  moderate/high  risk  group.  The  scale  had  a 
sensitivity  of  57.1%  for  the  outcome  of  maltreatment.  Of  the  previous  efforts  to  use  structured 
clinical  judgment,  the  Family  Stress  Checklist  had  the  highest  sensitivity  (80%)  (24).  However, 
in  that  study,  classification  of  the  outcomes  was  done  by  persons  who  had  knowledge  of  the 
children’s  demographics  and  perinatal  events,  thereby  introducing  the  possibility  of  detection 
bias.  More  importantly,  maltreatment  was  broadly  defined  such  that  an  accident-prone  child  was 
classified  as  being  neglected  according  to  the  criteria  used  in  that  study.  The  K-L  is  a  good 
predictor  of  maltreatment  with  28.6%  positive  predictive  accuracy,  improving  on  Browne  and 
Saqi’s  positive  predictive  accuracy  of  6%  (5). 

b.  Overall,  when  all  three  outcomes  were  considered  (maltreatment,  growth  concerns  or  major 
change  in  caretaker),  the  moderate/high  risk  group  was  2.56  times  more  likely  to  have  one  of 
these  outcomes.  The  scale  had  a  sensitivity  of  51.6%  and  the  positive  predictive  accuracy  rose  to 
38.1%  when  at  least  one  of  the  major  outcomes  was  considered. 

c.  When  single  items  or  categories  on  the  K-L  were  examined,  a  history  of  or  suspiscion  of 
maltreatment  was  the  best  predictor  of  maltreatment.  A  history  of  prior  maltreatment  or 
suspicion  of  maltreatment  was  the  best  predictor  of  maltreatment.  The  most  common  risk  factor 
in  maltreated  children  was  a  moderate  or  high-risk  score  in  the  category  of  maternal 
characteristics  such  as  drug  or  alcohol  abuse. 
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Strengths  of  the  study 

The  K-L  incorporated  known  risk  factors  for  maltreatment  and  attempted  to  provide  a 
continuum  along  which  items  could  be  scored.  The  majority  of  the  mothers  were  single  and  were 
the  primary  caretaker  of  the  child.  The  Kung-Leventhal  Parenting  scale,  therefore,  is  appropriate 
in  being  oriented  towards  the  mothers’  characteristics  and  behaviors.  The  scale  also  incorporates 
information  regarding  the  father,  acknowledging  the  father’s  role  in  affecting  the  lives  of  the 
children  with  whom  they  may  be  involved  even  peripherally.  For  the  K-L  to  be  completed 
specially  trained  clinicians  are  not  required,  and  its  use  in  the  postpartum  period  should  provide 
ample  opportunity  to  provide  services  to  those  families  identified  as  high  risk. 

We  followed  patients  from  birth  to  4  years,  the  time  during  which  maltreatment  is  most 
likely  to  occur.  In  our  study,  the  problem  of  surveillance  was  likely  minimized  since  the  number 
of  visits  to  the  primary  care  center  and  the  rates  of  unintentional  injuries  were  similar  in  both 
groups. 

Finally,  the  use  of  pre-defined  criteria  by  a  blinded  reviewer  to  evaluate  injuries  as 
maltreatment  or  unintentional  injury  decreased  the  likelihood  that  the  classification  was  affected 
by  the  reviewer’s  knowledge  of  the  risk  status  or  demographic  information. 

Limitations  of  the  study 

This  study  did  not  show  a  statistical  difference  in  the  occurrence  of  growth  concerns  in 
high  vs  low  risk  groups.  Similarly,  the  study  done  by  Leventhal,  Garber,  and  Brady  in  1989 
showed  that  the  unstructured  clinical  judgments  by  clinicians  were  not  predictive  of  failure-to- 
thrive  in  the  high  risk  vs  low  risk  groups  (22).  The  reason  the  K-L  scale  did  not  show  a  difference 
may  have  been  due  to:  (1)  the  small  sample  size  of  89  or  (2)  the  small  number  of  total  cases  of 
documented  growth  concerns.  There  were  children  who  had  been  seen  only  once  after  discharge 
from  the  hospital,  which  satisfied  the  eligibility  criteria  for  the  study  but  does  not  provide 
adequate  information  regarding  growth  characteristics.  This  was  not  a  problem  in  the 
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documentation  of  visits  to  the  emergency  department  since  children  in  New  Haven  usually  utilize 
only  2  emergency  departments  (Yale-New  Haven  Hospital  or  Hospital  of  St.  Raphael's),  while 
they  may  utilize  a  greater  number  of  community  physicians  and  other  health  centers  whose 
records  were  unavailable  to  us. 

Given  the  small  sample  size  used  in  this  study,  any  loss  to  follow-up  affects  the 
predictive  validity  of  the  instrument.  There  were  children  in  both  groups  who  had  very  few  visits 
to  the  primary  care  center,  having  switched  to  a  primary  care  provider  out  of  the  New  Haven  area 
or  to  a  physician  whose  records  were  unavailable  to  us.  This  is  significant  because  information 
about  some  injuries,  changes  in  the  child’s  caretaker,  and  particularly  growth  concerns  are 
documented  during  visits  to  the  primary  care  provider.  Therefore,  inadequate  information  in 
those  cases  may  have  resulted  in  a  lower  predictive  accuracy. 

Ethical  Concerns 

Since  the  focus  of  secondary  prevention  is  on  the  detection  of  a  high-risk  population, 
many  authors  have  been  concerned,  and  rightly  so,  with  the  psychological  effects  of  labeling  a 
family  as  high  risk,  particularly  when  the  label  is  misdirected  (33).  However,  in  the  clinical 
setting,  clinicians  regularly  identify  patients  at  risk  of  organic  diseases  by  standardized  clinical 
criteria.  In  this  study,  the  specificity  was  76%  for  the  outcome  of  maltreatment,  which  means 
that  the  K-L  incorrectly  identified  24%  of  the  infants  who  were  not  maltreated  as  moderate/high 
risk.  If  the  K-L  were  a  more  specific  instrument,  it  would  address  the  concerns  regarding 
mislabeling  and/or  stigmatization  of  high-risk  families.  Nevertheless,  the  test  is  sufficiently 
specific,  and  those  children  who  were  categorized  as  high  risk  would  most  likely  benefit  from 
any  interventions  that  may  be  provided  as  a  result  of  being  categorized  as  such. 

The  test  missed  43%  of  the  children  who  were  maltreated.  This  is  important  in  assessing 
the  importance  of  detecting  high  risk  groups  since  missing  the  children  who  will  be  maltreated  is 
likely  to  be  more  costly  in  terms  of  morbidity  and  mortality  than  the  possible  psychological 
consequences  of  being  mislabeled  as  a  high  risk  family. 
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Problems  with  predictive  studies 

Predictive  studies,  in  general,  are  affected  by  losses  to  follow-up  incurred  over  the  period 
of  the  study.  The  shrinking  sample,  as  well  as  interventions  and  major  life  events  that  may  have 
occurred  over  time,  may  result  in  less  accurate  predictions.  Further,  in  this  study,  we  were 
dependent  on  documentation  of  baseline  characteristics  of  the  sample  and  subsequent  events  in 
the  medical  record.  This  is  not  true  of  those  predictive  studies  in  which  subjects  are 
prospectively  enrolled  and  families  are  interviewed. 

The  socioeconomic  status  of  the  population  examined  is  important  for  interpreting  results 
of  a  predictive  study.  The  predictive  validity  of  an  instrument  to  identify  maltreatment  in  a 
predominantly  low-income  population  may  not  be  generalizable  to  other  populations  with  mixed 
or  higher  income  groups. 

Finally,  detection  bias  may  be  introduced  in  studies  of  predictive  validity,  if  the  clinician 
who  evaluates  outcomes  is  not  blinded  to  the  child’s  risk  status  and  other  information  that  may 
influence  the  classification  of  the  outcome.  The  definition  of  outcomes  should  be  clearly  defined 
and  steps  taken  to  reduce  detection  bias  to: 

a.  prevent  misclassification  between  subjects  (i.e.  classifying  an  injury  in  one  child  as  abuse, 
while  classifying  the  same  injury  in  another  as  an  accident). 

b.  prevent  misclassification  between  groups  (i.e.  classifying  injury  events  as  abuse  in  a  high- 
risk  child,  and  the  same  injury  as  an  accident  in  a  low-risk  child. 
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Conclusion 

Child  maltreatment  is  an  important  medical  and  social  disease  that  can  be  prevented  (22a). 
The  lives  lost  and  the  morbidity  of  the  problem  indicate  the  need  for  prediction  and  prevention  so 
that  limited  resources  can  be  directed  better  towards  high-risk  populations. 

Clinicians  do  a  good  job  of  making  unstructured  clinical  impressions  to  identify  children 
who  are  at  high  risk;  this  study  shows  that  the  clinical  judgment  of  child  maltreatment  can  be 
structured  to  allow  for  more  accurate  detection  of  high-risk  infants. 

Although  not  a  perfect  screening  instrument,  the  Kung-Leventhal  Parenting  scale 
effectively  identifies  infants  at  risk  of  maltreatment.  Further,  the  scale’s  predictive  value 
increases  if  other  adverse  outcomes  such  as  a  major  change  in  the  child’s  caretaker  and  growth 
concerns,  which  may  have  major  effects  on  the  child,  are  considered.  The  development  and 
testing  of  this  instrument  is  a  positive  step  towards  the  use  of  a  standardized  scale  in  the  clinical 
setting  to  detect  infants  at  high  risk  of  maltreatment. 
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